ARTIFICIAL INTELLIGENCE Microsoft’s Updated DeepSpeed Can Train Trillion-Parameter AI Models With Fewer GPUs Kyle Wiggers | TechCrunch “The enhanced DeepSpeed leverages three techniques to enable ‘trillion-scale’ model training: data parallel training, model parallel training, and pipeline parallel training. …Thanks to these and other performance improvements, Microsoft says a trillion-parameter model could be scaled across as […]
This Week's Awesome Tech Stories From Around the Web (Through September 12)
Singularity Hub - 12 Sep 2020 16:00
ARTIFICIAL INTELLIGENCE Microsoft’s Updated DeepSpeed Can Train Trillion-Parameter AI Models With Fewer GPUs Kyle Wiggers | TechCrunch “The enhanced DeepSpeed leverages three techniques to enable ‘trillion-scale’ model training: data parallel training, model parallel training, and pipeline parallel training. …Thanks to these and other performance improvements, Microsoft says a trillion-parameter model could be scaled across as […]
Share this Article
Recommended